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(54) FEATURE POINT TRACING DEVICE 

(57)Abstract: 

PROBLEM TO BE SOLVED: To improve tracing precision and to relax the condition of 
a point capable of being traced in a feature point tracing device to trace the motion of 
feature point of object in a video. 

SOLUTION: A feature point tracing means is constituted of plural different feature 
point tracing means 11 to 13 in which plural different matching degree evaluation 
means 21 1 to 232 are used respectively. One of the plural feature point tracing means 
11 to 13 is selected for respective feature point of an object video 5 and traced 
according to the contents preliminarily written in a feature point recording means 4 by 
a tracing control means 3. In this way, tracing of a similar point is enabled and the 
tracing accuracy is improved by using plural different matching degree evaluation 
means by the respective feature point tracing means. On the other, hand, the feature 



point impossible to be traced by a certain feature point tracing means is traced by 
another feature point tracing means by selecting and using the prepared plural 
different feature point tracing means. Consequently, the tracing accuracy is improved 
and the condition of the point capable of being traced is relaxed. 

* NOTICES * 

JPO and INPIT are not responsible for any 
damages caused by the use of this translation. 

"I.This document has been translated by computer. So the translation may not reflect 
the original precisely. 

2.**** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



CLAIMS 



[Claim(s)] 

[Claim 1]A focus tracking device which considers an initial value of an object image 
characterized by comprising the following by which a subject was photoed, and the 
focus arranged on this subject as an input, and pursues a motion of the focus 
according to a motion of a subject in this object image. 

Several different characteristic point tracking means using an output from two or 
more matching degree evaluation methods. 

A focus recording device which recorded a characteristic point tracking means which 
should be used when pursuing the present coordinates and the focus of said focus, 
Present coordinates and a characteristic point tracking means of said focus are read 
in said focus recording device, A focus tracking control means which repeats 
processing which chooses one of said the characteristic point tracking means, 
searches for the new coordinates of this focus, and writes this in this focus recording 
device for every new frame of said object image to these all the focus. 

[Claim 2]As said matching degree evaluation methods, classification-by-color cloth 
matching degree evaluation methods, Have edge matching degree evaluation methods 
and outline deformation degree evaluation methods at least, and as said characteristic 
point tracking means, The focus tracking device according to claim 1 characterized by 
what it has said classification-by-color cloth matching degree evaluation methods, a 
characteristic point tracking means using said edge matching degree evaluation 



methods, and said edge matching degree evaluation methods and a characteristic 
point tracking means using said outline deformation degree evaluation methods for at 
least. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention]In this invention, the focus on a subject is pursued in an image. 
Therefore, it is related with the focus tracking device which pursues a motion of a 
subject. 

[0002] 

[Description of the Prior Art]Pursuit of the focus will have been performed by 
searching for the point whose remainder in a window decreases most in inter-frame, if 
a square window is provided focusing on the focus and the new frame of an object 
image is given. About the above-mentioned art, for example, "Tomasi and Kanade 
work Shape, and Motion from Image. Streams:a FactorizationMethod-Part 3 Detection 
and Tracking of Point Features" (Technical Report of School.) It is indicated to of 
Computer Science, Carnegie Mellon University, and CMU-CS-91 -132-1 991. 
[0003] 

[Problem(s) to be Solved by the Invention]However, in the above-mentioned 
conventional technology, the focus arranged on a border line might shift from on the 
border line little by little, and there was a problem that the accuracy of pursuit was not 
enough. There was a problem that the point which can be pursued had the severe 
conditions which should be fulfilled since it is restricted to a point like an angle which 
is geometrically characteristic, and only a small number could arrange the focus which 
should be pursued. 

[0004]Then, this invention raises the tracing accuracy of the focus and makes it a 
technical problem to provide the focus tracking device which eased the conditions of 
the point which can be pursued. 
[0005] 

[Means for Solving the Problem]In order to solve the above-mentioned technical 
problem, the 1st invention by this invention considers an initial value of an object 
image by which a subject was photoed, and the focus arranged on this subject as an 
input, and a focus tracking device which pursues a motion of the focus according to a 
motion of a subject in this object image is equipped with the following. 
Several different characteristic point tracking means using an output from two or 



more matching degree evaluation methods. 

A focus recording device which recorded a characteristic point tracking means which 
should be used when pursuing the present coordinates and the focus of said focus. 
Present coordinates and a characteristic point tracking means of said focus are read 
in said focus recording device, A focus tracking control means which repeats 
processing which chooses one of said the characteristic point tracking means, 
searches for the new coordinates of this focus, and writes this in this focus recording 
device for every new frame of said object image to these all the focus. 

[0006]Similarly the 2nd invention by this invention as said matching degree evaluation 
methods, Classification-by-color cloth matching degree evaluation methods and edge 
matching degree evaluation methods, Have outline deformation degree evaluation 
methods at least, and as said characteristic point tracking means, It has said 
classification-by-color cloth matching degree evaluation methods, a characteristic 
point tracking means using said edge matching degree evaluation methods, and said 
edge matching degree evaluation methods and a characteristic point tracking means 
using said outline deformation degree evaluation methods at least. 
[0007]In this invention, a characteristic point tracking means comprises several 
different characteristic point tracking means, and each characteristic point tracking 
means pursues by specifying a characteristic point tracking means for every focus 
using an output of several different matching degree evaluation methods. Two points 
are the main features of this invention above. In a Prior art, a point of having used a 
single characteristic point tracking means and matching degree evaluation methods is 
improved in this invention. 

[0008]In the 1st invention by this invention, a characteristic point tracking means 
uses an output from two or more matching degree evaluation methods. Therefore, it 
becomes possible to pursue a similar point and tracing accuracy improves. On the 
other hand, a characteristic point tracking means is that several different things are 
prepared and a tracking control means chooses one of them, and it becomes possible 
to also pursue the focus which cannot be pursued in a certain characteristic point 
tracking means by another characteristic point tracking means. Therefore, 
improvement in tracing accuracy of the focus which is a technical problem of this 
invention, and conditions of a point which can be pursued can be eased now. 
[0009]In the 2nd invention by this invention, one of the characteristic point tracking 
means uses an output from classification-by-color cloth matching degree evaluation 
methods and edge matching degree evaluation methods. Therefore, it becomes 
possible to pursue a point that a classification-by-color cloth was similar on edge, and 
tracing accuracy improves. Another of a characteristic point tracking means uses an 
output from edge matching degree evaluation methods and outline deformation degree 
evaluation methods. Therefore, a point which, if possible, lessens modification from an 



initial state on edge can be pursued, and pursuit of a point which is geometrically 
featureless is also attained. Therefore, conditions about the focus which should be 
pursued can be eased. Thus, two or more different characteristic point tracking means 
are prepared, and when a tracking control means chooses one of them, it becomes 
possible to also pursue the focus which cannot be pursued in a certain characteristic 
point tracking means using an option by another characteristic point tracking means. 
Therefore, improvement in tracing accuracy of the focus which is a technical problem 
of this invention, and conditions of a point which can be pursued can be eased now. 
[0010] 

[Embodiment of the Invention] Hereafter, an embodiment of the invention is described 
in detail using figures. 

[001 1] Drawing 1 is a lineblock diagram of the 1st example of an embodiment showing 
the principle of this invention. 

[0012]In drawing 1 , a characteristic point tracking means (1) and 12 11 A 
characteristic point tracking means (2), The matching evaluation degree means (11) 
which uses 13 by a characteristic point tracking means (3), and 211 uses by the 
characteristic point tracking means 11, Another matching degree evaluation methods 
(12) which use 212 by the characteristic point tracking means 11, The matching 
degree evaluation methods (21) which use 221 by the characteristic point tracking 
means 12, Another matching degree evaluation methods (22) which use 222 by the 
characteristic point tracking means 12, The focus recording device on which the 
matching degree evaluation methods (31) which use 231 by the characteristic point 
tracking means 13, another matching degree evaluation methods (32) which use 232 
by the characteristic point tracking means 13, and 3 record a tracking control means, 
and 4 records the trace point of the focus, and 5 express the object image which 
consists of multiple frames. 

[0013]The characteristic point tracking means is constituted from several different 
characteristic point tracking means by this example of an embodiment like a 
characteristic point tracking means (1), a characteristic point tracking means (2), and 
— . The output of matching degree evaluation methods (11), matching degree 
evaluation methods (12), and the matching degree evaluation methods from which 
plurality differs like — is used for each characteristic point tracking means. The trace 
point control means 3 pursues by the object image's 5 carrying out each focus pair, 
and choosing one of the characteristic point tracking means with two or more 11, 12, 
13, and — based on the characteristic point tracking means currently written to the 
focus recording device 4. 

[0014]In this example of an embodiment, a characteristic point tracking means uses 
the output from two or more matching degree evaluation methods. Therefore, it 
becomes possible to pursue a similar point and tracing accuracy improves. On the 
other hand, two or more characteristic point tracking means are prepared, and when 



the tracking control means 3 chooses one of them, it becomes possible to also pursue 
the focus which cannot be pursued in a certain characteristic point tracking means 
using an option by another characteristic point tracking means. Therefore, 
improvement in the tracing accuracy of the focus which is a technical problem of this 
invention, and the conditions of the point which can be pursued can be eased now. 
[0015] Drawing 2 is a lineblock diagram of the 2nd example of an embodiment showing 
the principle of this invention. 

[0016]In drawing 2 , a characteristic point tracking means (1) and 12 11 A 
characteristic point tracking means (2), The matching evaluation degree means (1) 
which 21 uses by the characteristic point tracking means 11, another matching degree 
evaluation methods (2) which use 22 by the characteristic point tracking means 1 1 or 
the characteristic point tracking means 12, Furthermore it uses 23 by the 
characteristic point tracking means 12, the focus recording device on which another 
matching degree evaluation methods (3) and 3 record a tracking control means, and 4 
records the trace point of the focus, and 5 express the object image which consists of 
multiple frames. 

[0017]In this example of an embodiment, it has two, the characteristic point tracking 
means 11 and the characteristic point tracking means 12, as a characteristic point 
tracking means. The classification-by-color cloth matching degree evaluation 
methods (matching degree evaluation methods 21) which compare the state of the 
surrounding classification-by-color cloth of the specific point of two pictures as 
matching degree evaluation methods, It has the edge matching degree evaluation 
methods (matching degree evaluation methods 22) showing the degree by which the 
specific point has got on edge, and the outline deformation degree evaluation methods 
(matching degree evaluation methods 23) showing the degree of the modification from 
an initial state. The output of the classification-by-color cloth matching degree 
evaluation methods 21 and the edge matching degree evaluation methods 22 is used 
for the characteristic point tracking means 11. The output of the edge matching 
degree evaluation methods 22 and the outline deformation degree evaluation methods 
23 is used for the characteristic point tracking means 12. 

[0018]In this example of an embodiment, one of the characteristic point tracking 
means uses the output from classification-by-color cloth matching degree evaluation 
methods and edge matching degree evaluation methods. Therefore, it becomes 
possible to pursue the point that the classification-by-color cloth was similar on edge, 
and tracing accuracy improves. Another of the characteristic point tracking means in 
this example of an embodiment uses the output from edge matching degree evaluation 
methods and outline deformation degree evaluation methods. Therefore, the point 
which, if possible, lessens modification from an initial state on edge can be pursued, 
and pursuit of the point which is geometrically featureless is also attained. Therefore, 
the conditions about the focus which should be pursued can be eased. Thus, two or 



more different characteristic point tracking means are prepared, and it becomes 
possible to also pursue the focus which cannot be pursued in a certain characteristic 
point tracking means using an option by another characteristic point tracking means 
because the tracking control means 3 chooses one of them. Therefore, improvement 
in the tracing accuracy of the focus which is a technical problem of this invention, and 
the conditions of the point which can be pursued can be eased now. 
[001 9] Drawing 3 is a figure explaining the 3rd example of an embodiment of this 
invention. 

[0020]In drawing 3 , a characteristic point tracking means (1 ) and 12 11 A 
characteristic point tracking means (2), The matching evaluation degree means (1) 
which 21 uses by the characteristic point tracking means 1 1 , another matching degree 
evaluation methods (2) which use 22 by the characteristic point tracking means 1 1 or 
the characteristic point tracking means 12, Furthermore it uses 23 by the 
characteristic point tracking means 12, the focus recording device on which another 
matching degree evaluation methods (3) and 3 record a tracking control means, and 4 
records the trace point of the focus, and 5 express the object image which consists of 
multiple frames. Let the case where focus pursuit extracts a motion of a mouth from a 
face image be an example in this example of an embodiment. 

[0021]The example of the focus which should pursue in this case is shown in drawing 
4. The focus which should be pursued in this example is made into 12 points. The 
coordinates (x, y) are recorded on the focus recording device 4. It is recorded by 
which characteristic point tracking means each focus is pursued. In the case of the 
example of drawing 4 , they are the - points 1, 4, and 7 and 10:characteristic point 
tracking means (1). 

- Points 2,3,5, 6,8,9, 11, and 12 : characteristic point tracking means (2) 
It carries out. 

[0022]Matching degree evaluation methods (1) 21 evaluates the matching degree of a 
classification-by-color cloth, and considers the single-sided tap length n of picture l v 
a point (x, y), picture I 2 , a point (u, v), and a window as an input. Like drawing 5 , on 
picture I, and picture picture I 2 , the window of the square of a length (2n+1) of one 
side is made, and the total value of the difference of the RGB value in two windows is 
calculated and outputted according to the following formulas. 

[00233d,. CI,, x, y, I 2 , u, v) =sigma j= _ n n [{I 1R (x+i, y+jH 2R (u+i, v+j)} 2 +{I 1G (x+i, y+j)-I 2G . (x+i, 

y+j)} 2 + 0, B Gc+i f y+JHe (x+i, y+j)} 2 ] 

Here I 1R (x, y), I 1G (x, y), and I 1B (x, y), I 2R (u, v), I 2G (u, v), and I 2B (u, v) shall express red 
[ in / for the red in a point (x y), and a green and blue luminance value / a point (u, v) ], 
and a green and blue luminance value in picture I 2 in picture I lf respectively. It can be 
said that there are few differences in the classification-by-color cloth in two windows, 
so that this value d t is small. The notation of sigma i= _ n n in a formula shows total from 
i=-n to i=n (following, the same). 



[0024]Matching degree evaluation methods (2) 22 expresses the degree which has a 
point on a picture on edge, and considers the single-sided tap length m of the picture 
I, coordinates (x, y), and a window as an input. It asks for edge image E from the 
picture I first. And according to the following formulas, it is considered as the output 
of these evaluation methods in quest of the sum total of the edge luminosity in the 
surrounding point of a point (x, y). 
[0025]d 2 (I,x,y) =sigma i= _ m m sigma j= . m m E (x+i, y+j) 

It can be called the high point of the degree on edge, so that this value is large. E (x, y) 
shall express the luminosity of the edge image in a point (x, y). 

[0026]The matching degree evaluation methods 3 express the degree of the 
modification from an initial position, and consider the coordinates of two or more 
points as an input. In this example of an embodiment, the number of the points used as 
an input is set to 4. The present coordinates of the point i are made into (x if y^ (i= 1, 
— , 4). Distance I, between points, l 2 , l 3 and angle theta^ which a line segment makes, 
and theta 2 are defined like drawing 6 , and each initial value is made into l 10 , 1 20 , 1 30 , 
theta 10 , and theta 20 . If it thinks as a flexible model which connected between points by 
means of a spring, The elastic potential energy by the modification from an initial state 
d 3 . (x 1f y 1( x 2 , y 2 , x 3 , y 3> x 4 , y 4 ) =sigma i=1 3 lambda i (l i -l i0 ) 2 +sigma j=1 2 mUj. (thetaj-thetajo) It is 
given by 2 and this value is considered as the output of these evaluation methods. It 
can be said that there is little modification from an initial state, so that this value is 
small, lambdaj and muj are elastic coefficients and are defined beforehand. 
[0027]Characteristic point tracking means (1)11 uses the output of matching degree 
evaluation-methods (1) 21 and matching degree evaluation-methods (2) 22. When the 
present image frame I cur , the present coordinates (x, y) of a trace point, and the next 
image frame I next are given, the new coordinates (x+deltax, y+deltay) of a trace point 
are searched for. For this reason, the search range of delta x and delta y is made into 
- K=delta x<=l and - K=delta y<=l, and it asks for delta x and delta y which make a 
lower type the minimum. 

[0028]J 1 (x [ delta ], delta y) =d 1 (I cur , x, y, I next , x+deltax, y+deltay)+w-d 2 (I next , x+deltax, 
y+deltay) 

Here, since it can say that the value of d 2 has got on edge, so that it is large, w 
considers it as a negative constant and minimizes J v w is a weighting factor of two 
rate scales, and is defined beforehand. 

[0029]Characteristic point tracking means (2) 12 uses the output of matching degree 
evaluation-methods (2) 22 and matching degree evaluation-methods (3) 23. The 
present image frame I cur , the coordinates (x jf y) (i= 1, — , 4) of the present trace point, 
the next image frame I next , and the new coordinates of the trace points 1 and 4 
(x+deltax,, y^deltay^, When (x 4 +deltax 4 , y 4 +deltay 4 ) are given, the new coordinates 
(x 2 +deltax 2 , y 2 +deltay 2 ) of the trace points 2 and 3, and (x 3 +deltax 3 , y 3 +deltay 3 ) are 
calculated. For this reason, search range of deltaXj and deltay - It is considered as 



r<=deltax;<=r and -r<=deltayj<=r and deltaXj and deltay which make a lower type the 
minimum are calculated. 

[0030]J 2 . (deltax 2 , deltay 2 , deltax 3 , deltay 3 ) =w'-sigma j=:1 2 d 2 (I cur , x jf y., I next , and Xj+deltax 
— ) [ i and ] y j +deltay i +d 3 . (xj+deltax,, y^deltay,, x 2 +deltax 2 , y 2 +deltay 2 , x 3 +deltax 3 , 
y 3 +deltay 3 , x 4 +deltax 4 , y 4 +deltay 4 ) 

Here, since it can say that the value of d 2 has got on edge, so that it is large, w' 
considers it as a negative constant and minimizes J 2 . w' is a weighting factor of two 
rate scales, and is defined beforehand. 

[0031]In order to operate this example of an embodiment, the initial position of each 
focus and the pursuit method are first set to the focus recording device 4. The 
tracking control means 3 investigates the portion of the tracking means of the focus 
recording device 4, and selects the thing using a characteristic point tracking means 
(1). In this case, the points 1, 4, 7, and 10 correspond. The new coordinates of a trace 
point are searched for by a characteristic point tracking means (1) from these points 
by using as the frame 1 the value currently written [ image frame / present ] to the 
focus recording device 4 in the value of the frame 0 and the present trace point, and 
the following image frame. The value of the focus recording device 4 is updated by this 
result. 

[0032]Next, the tracking control means 3 chooses the focus which uses a 
characteristic point tracking means (2). In this case, the points 2, 3, 5, 6, 8, 9, 11, and 
12 correspond. First, a characteristic point tracking means (2) is applied to the points 
1, 2, 3, and 4. Since the new coordinates of the points 1 and 4 are already searched for 
by the characteristic point tracking means (1), the new coordinates of the points 2 
and 3 are searched for by a characteristic point tracking means (2). Similarly, the new 
coordinates of the points 5 and 6 are searched for by applying a characteristic point 
tracking means (2) to the points 4, 5, 6, and 7. Furthermore, the new coordinates of 
the points 8, 9, 1 1, and 12 are also searched for. 

[0033]Thus, the new coordinates of each focus on the frame 1 are searched for. The 
new coordinates of each focus on the frame 2 are searched for by using the frame 1 
as the present image frame, and using the frame 2 as the following image frame. 
Pursuit of each focus is performed by repeating this. 

[0034]By such composition, a border-line top can be correctly pursued by using the 
matching degree evaluation methods (1) and (2) to the points 1, 4, 7, and 10. Although 
it cannot pursue by a characteristic point tracking means (1) to the remaining points, 
it becomes possible to pursue by preparing a characteristic point tracking means (2). 
[0035]From this result, there is an improvement whose accuracy of pursuit improves 
compared with a Prior art that a trace point can be increased, clearly like. 
[0036] 

[Effect of the Invention]According to this invention, as explained above, the tracing 
accuracy of the focus improves, and since arrangement of more trace points is 



attained, it is effective in the ability of pursuit of a subject to carry out with more 
sufficient accuracy. 



DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawing 1] It is a lineblock diagram of the 1st example of an embodiment showing the 
principle of this invention. 

[Drawing 2] It is a lineblock diagram of the 2nd example of an embodiment showing the 
principle of this invention. 

[Drawing 3] It is a lineblock diagram showing the 3rd example of an embodiment of this 
invention. 

[Drawing 4] It is a figure showing the example of the focus in the example of an 
embodiment of the above 3rd which should be pursued. 

[Drawing 5] (a) and (b) are the figures for supplementing with explanation of the 
matching degree evaluation methods (1) in the example of an embodiment of the 
above 3rd. 

[Drawing 6] It is a figure for supplementing with explanation of the matching degree 
evaluation methods (3) in the example of an embodiment of the above 3rd. 
[Description of Notations] 

1 1 — Characteristic point tracking means (1) 

12 — Characteristic point tracking means (2) 

13 — Characteristic point tracking means (3) 

21 — Matching degree evaluation methods (1) 

22 — Matching degree evaluation methods (2) 

23 — Matching degree evaluation methods (3) 

211 — Matching degree evaluation methods (11) 

212 — Matching degree evaluation methods (12) 

221 — Matching degree evaluation methods (21) 

222 — Matching degree evaluation methods (22) 

231 — Matching degree evaluation methods (31) 

232 — Matching degree evaluation methods (32) 

3 — Tracking control means 

4 — Focus recording device 

5 — Object image 
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8(11), 77f>y , fiSi?g (12), 

s-^vt, 11, 12, 13, ■■■(offlk&zttm&mm 

[0 0 14] *HS6^0l|(CfcV^T«, #«j&il8*3M8 

f»»a*^±-rs 0 -73, wm&mmmmim&mMz 

flTfcD, ^SfaMfflJ^ISS*^©?^© 1 o£jg#?T 5 



*ff 5 C i: #m#5 3 tc a S . 

[ooi 5] 02 *ftm<Dmm*7n?m2<Dnm& 

[0 0 16] H2tcfeV>T, 1 1 

(D , 1 2 (2) , 2 ni^m^ii 
»?ai i ■pfflv^v-yfyy'Mafa co , 22 

sgijov>y^>^ajHffi^a (2) , 2 3 t±w«jSiifij: 

3Mft 1 2T-ffll/^$?,iCglJcDT'y^y^Jgfpfffi^g 

(3) , 3 nmmmm^, timm&cDim'&mm 

[0017] *mmmm-e\t. mbssm^mnisT 
fflk&msi&mi 1, wm&jBM^-mi 2020^1 

T-ytf&mmm®. c?y9->?mmm&2 d 33 
v-y^->yia*pffi^ia (v-y^>^i5Wffi¥©2 2) 

m% (V7fy^ifg2 3) i:**-rs 0 

1 nt. v^y-ymmm^m 2 1 tx 

1 2 X7i>'.?7f> vmmm^-wt. 2 2 

[0018] ^mmmmmic^rit, wm&mm^m 
<d 1 otfMir? y ?■ > vmmm^s X <y ^ • V -y 7 
y ymmn&^&fr e> ©m^^f uffl-r s= ^ o 46 1 x -y 

IS© t> 3 1 o S , x >y i? • v >y f - > ^'ffilffffi^ia 

i: Hi P^ff^ afpffi^s^ e <d a ^ *fijffl -r s o *o 

i6, X<y ^±«W««S^?>©^^^S^< '>ft < f 

*f§f^©isiiT-fes#a*,©3a^sja©(p]±, jgwariie 
[0019] 03a« *mn<Dm3<DmMBmm*mm 

[0 0 2 0] 0 3tC*5V^T, 1 1 {±^«^iifS*¥S 

(1) , 1 2 «fra^s##is (2) , 2 i«#a^js 

1 T-ffl^SV'y^^yWfffifiXg (1) , 2 2 



(4) 



#It1¥ 1 1 - 1 2 0 3 6 4 



z>%i<D^'y?->?'mmimm (2) , Z3imm^m 

#Sl 2 Tffl v»a * 6 fc»JO V -y ^- > ?'fi¥Pffi^© 

(3) % 3 {±iiM*w»¥Ss 4 {iwa^oiisii^^aBS 
[0021] £<dm&<d, m$F?'<z&m&<Dm*m4 

Offil (x, y) !W«j6Ea^«4fcE*S*l*o * 
tieii-TSo 04<OfiRj£D«^ 

• £ 1 . 4 , 7 , 10: wa^iiw^s ( 1 ) 

• jS 2 . 3, 5, 6, 8, 9, 11. 12: ftgt&SIMi 

¥!S (2) 

[0 0 2 2] V-y^>^JgfPfffi#^ ( 1 ) 2 Hi. 

Yri^v-y^v^'ffi^riffffi-r^feOT 5 , Mil x , $ 

(x, y) , H#I 2 , (u, v) , £ -r 
m$~y-f&n*Atlt-?Z> 0 0 5©«fc3fc:, iifflfK I j± 
i:H{tiii# I 2 ±{c— i2<DfiS (2 n + 1 ) (DjE?JB<D 
t><<y K»>*f^D, BfflOzS 

[0023] dj (Ij, x, y, 1 2 , u, v) =2 
1= _ n n [ { I ir ( x + i , y + j ) - I 2R (u + i , v 
+ j) } 2+ {I 1G (x+i, y + j) -I 2G (x + 

i , y + j ) } 2 + I I 1B (x+ i , y + j) - I 
2B (x + i , y + j ) } 2] 

CUT, I 1R (x, y) , I 1G (x, y) , I 1B (x, 

y) w«i (x, y) ic&ifzm. m, n 
wmmrn, i 2 r(u, v) , i 2G (u, v) , 1 

2B (u, v) fi, PMH 2 *T*j6 (u, v) 

'>ftl^£:^;t3 0 ftfc\ S*©Z 1= _ n n ®^SB«\ i = 
- n^f, i = n $T©»/fNtt^5 (t(T, hD 

ttt) o 

[0 0 2 4] V-yf-y^ffiffffiX^ (2) 2 2 MS 
mW. (x, y) , VjyY^tDKmZv-f&mltXtlt 
TO^fCLfc^oT, £ (x, y) OJiaO^T<0X<y 

[002 5] d 2 (I, X, y) =Z 1= _ m m Zj= m m E 

(x+ 1, y + j) 

ft*5, E (x, y) ltt& (x, y) tCfcttSX-y 
[0 0 2 6] V>y^>yjgffpfffi^©3fi, ftJJWftBfrS. 



j£i©Jlffi©&«* (x„ y A ) (1 = 1. -, 

4) „ HeoiaiLjSlfflOEIi!, l 2 , i 3 i:^© 

a-r^fie^ e 2 ^«u zn^nommmz 1 10 , 
i 20 . i 30 . 0io. o zo t?%o Mm&i*-&i8A,ism 

■ftx^l^-ti 

d 3 y x , x 2 , y 2 , x 3 , y 3 , x 4 . y 4 ) =2 

i=i 3 ^ (1 i-l io) 2 +Z J = 1 2 /i J (Sj-Sjo) 2 

*Vh£v>B HWWtf e^g^^ft^ i: v^A So ft 
[0 0 2 7] &flt£]gM^& (1) 118. V>y^>y 

fifFfffi^is (1)21 >?mmffi&®. (2) 2 
^<om&(omm ix, y) i:^©i«7u-Ai next tf 

W^tlfttt, i§»^^«T/iftffiiS (x + Ax. y + 
Ay) ?r5)<i6i, 0 <KDfcH>lC A x . A y cDSfMf5ffl£- 
1 < A x < 1 . - 1 < A y < 1 t U Ti^fi/NcTS 
Ax, Ay^5R46So 

[0 0 2 8] J, (Ax. Ay) =d, (I cur , x. 
y - I next. x + Ax, y + A y ) + w • d 
, (I next' x + Ax, y + Ay) 
ililt, d 2 CQ{fite7^l^ii ifx«y >?±{C©t>"£V3 £ 
M5©7, wtiiiOSiiJi: LJ ^^Mtt^o wit 

T*5< 0 

[0 0 2 9] 1$«j£ilBNMft (2) 1 2 V-y^>^ 

flOWf® (2) 2 2 t-w?-y7imm^® (3) 2 
3<E>m7^*iJfflT3o Jlffi©iB#71^-A I cur i:fjH£ 

Oii»Ji50lfl (x„ y,) (i = l, -, 4) 

u-a i next fciisj:^ i , 4 cDffrcftffiis ( x , 

+ Ax 1( y! + Ay,) , (x 4 +Ax 4 , y 4 +Ay 4 ) 
t^X^tlfct^, mm&2, 3©»rfcft*|* (x 2 + 
Ax 2 , y 2 +Ay 2 ), (x 3 +Ax 3 , y 3 +Ay 3 )£r 
5t<463o CCDfcisbic, Ax„ A y 1 ©S?^|EH ; Sr— 1 ' 
<Ax t <I' , -1' <Ay,<r fcU T5££«/J> 
ttSAx,, A y i^sfc&So 
[0 0 3 0] J 2 (Ax 2 , Ay 2 , A x 3 , Ay 3 ) = 
w' • I 1=1 2 d 2 (I cur , x t . y„ I next> x t +A 
Xj, y,+ Ay,) +d 3 (x,+ Ax„ y,+ Ay,, x 
2 +Ax 2 , y 2 +Ay 2 , x 3 +Ax 3 , y 3 +Ay 3 , x 4 
+ Ax 4 , y 4 +Ay 4 ) 

ililT', d 2 <Dmt± % t/ if X >y i>'±(CC0 o T I ^ i: 

[003 1 ] ^mMBmmzmft-z&zicte, 



(5) 



1 1 - 1 2 0 3 6 4 



t § o mmfflw&& 3 t,m®. *teii¥is 4 tomm^m® 

»»*W^ Hfflt£&t££& (1) fcfflvSfcOfcStf 
m-To d j*C 1 , 4, 7, 1 OAl^tSo Ctl 

(1) f;:«fc»)iiB|!^o»frc*ffiai**i6S 0 

[0 0 3 2] ^{C. ^ftjfi^lft 3 

(2) ttm^z>ftM&.*miR-?2>o coi^, ^2, 

3, 5, 6, 8, 9, li, 1 2^^-r^o *?\ * 

1, 2, 3, 4tC*fLT, ^M^ii^K (2) ^Jlffl 

(1) tcj;?)*i6e.nTi/^©T\ wwiMjMM^®. 

(2) ic«to, ^2, 3<o«f^*ffi«*^46e)nso m 

MICLT, jS4, 5, 6, 7 tC#&j£ii8*¥!S (2) % 

ti&o -$£>ic£.8, 9, li, i 2 <Dmrc^mm^ist> 

[0 0 3 3] C<D£v\CLT, 1 ±t?£D#^« 

SC^tciD, 7I/-A2lTOSIfi^0Klrft418 

[0 0 3 4] C ©J: 3 9, jSl. 4, 7, 1 

OfCisfUTtt-r-yf-y^fiSPfflS^S (1) t (2) 

K9MRj^jfU»#a (2) t>;ij]tLT*3< <i 
i: Til^f set TbMtgfc * 5 o 

[0 0 3 5] C©*S*^e>W?.*HC e fe3fC, 
[0 0 3 6] 



[^ 2 ] *5§H^o^ji^^-r^ 2 (ommnmM(Dmmm 

[0 3] *SIW©^3<D*i6^0!l%^-r«^c01?^ 

-So 

[04] ±mm3<DmmnmmT(Dmm-r^¥fmi^<D 

[0 5] (a) , (b) fi, ±3B£3<D5S8BJ$g0IJ-C<D 

v-y^y^"Sffpffi^S (l) coiKHi!«i£-r?>fca6co0 

[0 6 ] ±fEfg 3 <Dmi&BBM-?<D-? -y^-y ?'Jt?p{ffi¥ 
Wl (3) OgttW*MJ£-rSfc«)O0-p3BSo 

[ft^<oiBUl] 

i i ■■•ra«j±aaw¥© (i) 

1 2-»^ji^lS (2) 

1 3-«»siffl»^a (3) 
2 1 co 

2 2-V'y^-y^jtgffpfffi^lS (2) 
2 3--Vy^>^jSfPffi¥© (3) 

2 1 l-vy^^amwa (id 

2 1 2-"V-y^y^Jg*pffi^g (12) 
2 2 1 -V.y^>^j®ifffffi#© (2 1) 
2 2 2-*Wf->?8mW$®. (2 2) 

2 3 1 ■■■-^-j^y^mmmm^. o 1 ) 

2 3 2--V-yf->^JtfPfffi^g (3 2) 



[0 4] 



[0 5] 



3 4 5 




WfStf, 




Bf£/ 2 



(a } 




(6) 
[01] 
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7 U- A 0 




No. 




y 




1 


10 


10 


2 


2 


20 


15 


1 


3 


30 


45 


3 











5 *tm®& 



11 



i&W^a ( 1 ) 



12 



13 



211 



7f->^aEffFfiB^a(i2) 



212 



! 



221 



•*y*->r&tH&£9t. (22) 

""S i 

222 231 
/ 



*v + >rBXW£9L (32) 

i 

232 ' 



[06] 




(7) 



1 1 -12 0 3 6 4 



[0 2] 



7 1/-A0 




No. 


X 


y 




1 


10 


10 


i 


2 


20 


15 


2 



















21 

y 



22 



23 



1 1-12 0 3 6 4 



[0 3] 



7 U- A 0 





No. 


X 


y 




1 


10 


10 


i 


2 


20 


15 


2 


3 


30 


45 


2 


















1 2 


30 


10 


2 



5 tffcflWft 



V 

12 




21 



22 



23 



•7 7-f-y^*^flfi#S(3) 



4 



